
US008689083B2 


(12) United States Patent do Patent no.: us 8,689,083 B2 

Nguyen et al. ( 45 ) Date of Patent: Apr. 1, 2014 


(54) RATE-COMPATIBLE PROTOGRAPH LDPC 
CODES 

(75) Inventors: ThuyV. Nguyen, Dallas, TX (US); Aria 

Nosratinia, Plano, TX (US); Dariush 
Divsalar, Pacific Palisades, CA (US) 

(73) Assignees: California Institute of Technology, 

Pasadena, CA (US); Board of Regents, 
The University of Texas System, 

Austin, TX (US) 

( * ) Notice: Subject to any disclaimer, the term of this 

patent is extended or adjusted under 35 
U.S.C. 154(b) by 304 days. 

(21) Appl.No.: 13/158,263 

(22) Filed: Jun. 10, 2011 

(65) Prior Publication Data 

US 201 1/0307756 Al Dec. 15.2011 

Related U.S. Application Data 

(60) Provisional application No. 61/355,050, filed on Jun. 
15,2010. 

(51) Int.Cl. 

H03M 13/00 (2006.01) 

(52) U.S. Cl. 

USPC lUniA-, 714/781 

(58) Field of Classification Search 

None 

See application file for complete search history. 

(56) References Cited 

U.S. PATENT DOCUMENTS 


6,633,856 

B2 

10/2003 

Richardson et al. 


7,095,792 

B2* 

8/2006 

Doetsch et al 

375/265 

7,343,539 

B2 

3/2008 

Divsalar et al. 


7,499,490 

B2 

3/2009 

Divsalar et al. 



8,117,523 B2* 2/2012 Divsalar etal 714/801 

8,239,746 B2 * 8/2012 Divsalar etal 714/801 

8,495,450 B2* 7/2013 Abu-Surra et al 714/752 

8,560,911 B2* 10/2013 Abu-Surra et al 714/752 

2006/0291571 Al 12/2006 Divsalar et al. 

2006/0294445 Al 12/2006 Divsalar et al. 

2007/0162815 Al * 7/2007 El-Khamy et al 714/752 

2007/0283216 Al* 12/2007 Kyungetal 714/758 

2008/0059862 Al* 3/2008 Kyungetal 714/752 

2008/0222486 Al* 9/2008 Richardson et al 714/757 

2008/0294969 Al 11/2008 Divsalar et al. 

2009/0001933 Al 1/2009 Fu 

2009/0019333 Al 1/2009 McEvoyetal. 


(Continued) 

FOREIGN PATENT DOCUMENTS 

JP 2009-044732 2/2009 

JP 2009-44732 2/2009 

OTHER PUBLICATIONS 

Hu, X., Eleftheriou, E. and Arnold, D.M., “Regular and irregular 
progressive edge-growth tanner graphs,” IEEE Transactions on 
Information Theory, vol. 51, No. 1, pp. 386-398 (Jan. 2005). 

(Continued) 

Primary Examiner — Daniel McMahon 

(74) Attorney, Agent, or Firm — Steinfl & Bruno, LLP 

(57) ABSTRACT 

Digital communication coding methods resulting in rate- 
compatible low density parity-check (LDPC) codes built 
from protographs. Described digital coding methods start 
with a desired code rate and a selection of the numbers of 
variable nodes and check nodes to be used in the protograph. 
Constraints are set to satisfy a linear minimum distance 
growth property for the protograph. All possible edges in the 
graph are searched for the minimum iterative decoding 
threshold and the protograph with the lowest iterative decod- 
ing threshold is selected. Protographs designed in this manner 
are used in decode and forward relay channels. 

27 Claims, 8 Drawing Sheets 


THRES.HOLD OF THE. NEW PROTOGRAPH CODE FAMILY 




US 8,689,083 B2 

Page 2 


(56) References Cited 

U.S. PATENT DOCUMENTS 


2010/0023834 A1 * 1/2010 

2010/0169736 A1 7/2010 
2010/0192047 A1 7/2010 
2010/0257425 A1 10/2010 
2011/0047433 A1 2/2011 
2011/0066916 A1 3/2011 
2012/0131409 Al* 5/2012 


Richardson et al 714/751 

Garani et al. 

Murakami et al. 

Yue et al. 

Abu-Surra et al. 

Abu-Surra et al. 

Divsalaretal 714/752 


OTHER PUBLICATIONS 


Tian, T., Jones, C.R., Villasenor, J.D. and Wesel, R.D., “Selective 
avoidance of cycles in irregular LDPC code construction,” IEEE 
Transactions on Communications, vol. 52, No. 8, pp. 1242-1247 
(Aug. 2004). 

Tian, T., Jones, C.R., Villasenor, J.D. and Wesel, R.D., “Construction 
of irregular LDPC codes with low error floors,” IEEE International 
Conference on Communications, vol. 5, pp. 3125-3129 (2003). 
Abu-Surra, S., Divsalar, D. andRyan,W., “On the existence of typical 
minimum distance for protograph based LDPC codes,” Information 
Theory and Applications Workshop (ITA), pp. 1-7 (Jan. 2010). 
Divsalar, D., Dolinar, S., Jones, C. R. and Andrews, K., “Capacity 
approaching protograph codes,” IEEE J. Select. Areas Communica- 
tion, vol. 27, No. 6, pp. 876-888 (Aug. 2009). 

Liva, G. and Chiani, M., “Protograph LDPC codes design based on 
EXIT analysis,” in Proc. IEEE GLOBECOM, pp. 3250-3254 (Nov. 
2007). 

Jacobsen, N. and Soni, R., “Design of rate-compatible irregular 
LDPC codes based on edge growth and parity splitting,” in Proc. 
IEEE Vehicular Technology Conference (VTC), 2007, pp. 1052-1056 
(Oct. 2007). 

El-Khamy, M., Hou, J. and Bhushan, N., “Design of rate-compatible 
structured LDPC codes for hybrid ARQ applications,” IEEE J. Select. 
Areas Commun., vol. 27, No. 6, pp. 965-973 (Aug. 2009). 

Dolinar, S., “A rate-compatible family of protograph-based LDPC 
codes built by expurgation and lengthening,” Proc. IEEEISIT,pp. 1-5 
(Sep. 2005). 

Richardson, T. and Urbanke, R., “Multi-edge type LDPC codes,” 
Tech. Rep., pp. 1-36 (Apr. 2004). 

Abbasfar, A., Divsalar, D. andYao, K., “Accumulate-repeat-accumu- 
late codes,” /££■£■ Trans. Commun., vol. 55, No. 4, pp. 692-702 (Apr. 
2007). 

Li, J. and Narayanan, K. R., “Rate-compatible low density parity 
check codes for capacity-approaching ARQ schemes in packet data 
communications,” /" toc. CUT, pp. 1-6 (Nov. 2002). 

Yazdani, M. R. and Banihashemi, A. H., “On construction of rate 
compatible low-density parity-check codes,” IEEE Commun. Lett., 
vol. 8, No. 3, pp. 159-161 (Mar. 2004). 

Ha, J., Kim, J., and McLaughlin, S., “Rate-compatible puncturing of 
low density parity-check codes,” IEEE Trans. Inform. Theory, vol. 
50, No. 11, pp. 2824-2836 (Nov. 2004). 

Pishro-Nik H. and Fekri, F., “Results on punctured LDPC codes,” 
Proc. IEEE Information Theory Workshop, pp. 215-219 (Oct. 2004). 
Sendonaris, A., Erkip, E. and Aazhang, B., “User cooperation diver- 
sity. Parti: System Description,” Trans. Commun., vol. 51, No. 
11, pp. 1927-1938 (Nov. 2003). 

Sendonaris, A., Erkip, E. and Aazhang, B., “User cooperation diver- 
sity. Part 11. Implementation aspects and performance analysis,” 
IEEE Trans. Commun., vol. 51, No. 11, pp. 1939-1948 (Nov. 2003). 
Hunter , T. and Nosratinia, A. “Cooperation diversity through cod- 
ing,” Proc. IEEE ISIT, p. 220 (Jun. 2002). 

Laneman, J., Tse, D. and Wornell, G., “Cooperative diversity in 
wireless networks: Efficient protocols and outage behavior,” IEEE 
Trans. Inform. Theory, vol. 50, No. 12, pp. 3062-3080 (Dec. 2004). 
Laneman, J. and Wornell, G., “Distributed space-time-coded proto- 
cols for exploiting cooperative diversity in wireless networks,” /£££ 
Transactions on Information Theory, vol. 49, No. 10, pp. 2415-2425 
(Oct. 2003). 


Cover, T. and Gamal, A. E., “Capacity theorems for the relay chan- 
nel,” /£££ Trans. Inform. Theory, vol. 25, No. 5, pp. 572-584 (Sep. 
1979). 

Kramer, G., Gastpar, M. and Gupta, R, “Cooperative strategies and 
capacity theorems for relay networks,” IEEE Trans. Inform. Theory, 
vol. 51, No. 9, pp. 3037-3063 (Sep. 2005). 

Razaghi, P. and Yu, W., “Bilayer low-density parity-check codes for 
decode-and-forward in relay channels,” /PPP Trans. Inform. Theory, 
vol. 53, No. 10, pp. 3723-3739 (Oct. 2007). 

Xie, L.L. and Kumar, P.R., “An achievable rate for the multiple level 
relay channel,” /£££ Trans. Information Theory, vol. 51, No. 4, pp. 
1348-1358 (Apr. 2005). 

PCT International Search Report (ISR) mailed on Apr. 18, 2012 for 
PCT Application No. PCT/US20 1 1/040095 filed Jun. 10, 20 1 1 in the 
name of California Institute of Technology et al. 

PCT Written Opinion mailed on Apr. 18, 2012 for PCT Application 
No. PCT/US201 1/040095 filed Jun. 10, 2011 in the name of Califor- 
nia Instimte of Technology et al. 

Nguyen, T., et al.. The Design of Rate-Compatible Protograph LDPC 
Codes, IEEE 2010, 48“ Annual Allerton Conference, Sep. 29-Oct. 1, 

2010, 1-5. 

ten Brink, S., Convergence Behavior of Iteratively Decode Parallel 
Concatenated Codes, IEEE Transactions on Communications 2001, 
49: 1727-1737. 

Divsalar, D., et al.. Protograph based low error floor LDPC coded 
modulation, IEEE MILCOM 2005, 1: 1-8. 

Divsalar, D., et al.. Low-rate LDPC codes with simple protograph 
structure, Proc. IEEE ISIT 2005, 1-5. 

Nguyen, T., et al.. Bilayer Protograph Codes for Half-Duplex Relay 
Channels, IEEE 2010, Austin, Texas, Jun. 13-18, 2010, 948-952. 
Thorpe, J., Low-Density Parity-Check (LDPC) Codes Constructed 
from Protographs, IPN Progress Report 2003, 1-7. 

Thorpe, J., et al.. Methodologies for Designing LDPC Codes Using 
Protographs and Circulants, IEEE 2004, Chicago, Illinois, Jun. 
27-Jul. 2, 2004, 236. 

Tian, T., et al., Constmction of Rate-Compatible LDPC Codes Uti- 
lizing Information Shortening and Parity Puncturing, EURASIP 
Joinnal on Wireless Communications and Networking 2005, 5, 789- 
795. 

Hsu, C.-H., et al.. Capacity achieving LDPC codes through punctur- 
ing, IEEE Transactions on Information Theory, vol. 54, No. 10, Oct. 
2008, 4698-4706. 

Richardson, T. J., et al.. Design of capacity-approaching irregular 
low-density parity-check codes, IEEE Trans. Inform. Theory, Feb. 
2001, vol. 47, No. 2,619-637. 

Nguyen, T., et al.. Threshold of Protograph -based LDPC Coded 
BICM for Rayleigh Fading, IEEE Globecom 2011, Dec. 5-Dec. 9, 

2011, 1-5. 

A. Abbasfar et al., “Accumulate repeat accumulate codes,” Proc. 
IEEE Intern. Symp. on Inform. Theory (ISIT), Jun. 2004, p. 509-513. 
A. Ashikhmin et al., “Extrinsic information transfer functions: model 
and erasure channel properties,” IEEE Trans. Inform. Theory, 2004, 
vol. 50, No. 11, pp. 2657-2673. 

S.Y. Chung etal., “Analysis of sum-product decoding of low-density 
parity-check codes using a Gaussian approximation,” IEEE Trans. 
Inform. Theory, 2001, pp. 657-670. 

D. Divsalar et al., “Constmcting LDPC codes from simple loop-free 
encoding modules,” 2005 IEEE International Conference on Com- 
munications, pp. 658-662. 

M. El-Khamy et al., “H-ARQ rate-compatible stractured LDPC 
codes,” Proc. IEEE Intern. Symp. on Inform. Theory (ISIT), Jul. 
2006, pp. 1134-1138. 

M. Good et al., “Incremental redundancy via check splitting,” Proc. 
23”^ Biennial Symp. on Commun., IEEE, May 2006, pp. 55-58. 

J. Ha et al., “Rate-compatible punctured low-density parity-check 
codes with short block lengths,” IEEE Trans. Inform. Theory, Feb. 
2006, vol. 52, pp. 728-738. 

H. Jin etal., “Irregular repeat-accumulate codes,” Proc. Intern. Symp. 
on Turbo Codes and Related Topics, Sep. 2000, pp. 1-8. 

J.S. Lee et al., “A scalable architecture of a stractured LDPC 
decoder,” International Symposium of Information Theory, Jun. 
2004, ISIT 2004, p. 293. 



US 8,689,083 B2 

Page 3 


(56) References Cited 

OTHER PUBLICATIONS 

M. Luby et al., “Improved low-density parity-check codes using 
irregular graphs,” IEEE Trans. Inform. Theory, Feb. 2001, vol. 47, 

No.2, pp. 585-598. 

A. Orlitsky et al., “Stopping sets and the girth of Tanner graphs,” 2002 
IEEE International Symposium on Information Theory, 2002. 

T. Richardson et al., “The capacity of low-density parity-check codes 
under message-passing decoding,” IEEE Trans. Inform. Theory, Feb. 
2001, vol. 47, No. 2, pp. 599-618. 

A. Shokrollahi et al., “Raptor codes,” Proceedings 2004 IEEE Inter- 
national Symposium on Information Theory (ISIT2004), Chicago, 
IE, USA, 2004. 

A. Shokrollahi, “Raptor codes,” IEEE Trans. Inform. Theory, Jun. 
2006, vol. 52, No. 6, pp. 2551-2567. 

E. Soljanin et al., “Incremental redundancy hybrid ARQ with LDPC 
and raptor codes,” IEEE Trans. Inform. Theory, Sep. 2005, submitted 
for publication. 

S. Ten Brink et al., “Design of low-density parity-check codes for 
modulation and detection,” IEEE Trans. Commun., 2004, vol. 52, No. 
4, pp. 670-678. 


M. Tiichler et al., “EXIT charts of irregular codes,” Proc. Conf. on 
Inform. Sciences and Systems (CISS), Mar. 2002, Princeton Univer- 
sity, NJ, USA,pp. 1-6. 

H. Xiao et al., “Improved progressive-edge-growth (PEG) construc- 
tion of irregular LDPC codes,” IEEE Commun. Lett., Dec. 2004, pp. 
715-717. 

PCT International Search Report mailed Aug. 29, 2012 for PCT/ 
US20 11/062382 filed on Nov. 29, 2011 in the name of California 

Institute of Technology. 

PCT Written Opinion mailed Aug. 29, 2012 for PCT/US2011/ 
062382 filed on Nov. 29, 2011 in the name of California Institute of 
Technology. 

US Non-Final Office Action mailed Aug. 27, 2013 forU.S. Appl.No. 
1 3/306,3 1 6, filed Nov. 29, 20 1 1 in the name of California Institute of 
Technology & Board of Regents, The University of Texas System. 
PCT International Search Report mailed Apr. 18, 2012 for PCT/ 
US2011/040095 filed on Jun. 10, 2011 in the name of California 
Institute of Technology & Board of Regents, The University of Texas 
System. 

PCT Written Opinion mailed Apr. 18, 2012 for PCT/US201 1/040095 
filed on Jun. 0, 2011 in the name of California Institute of Tech- 
nology & Board of Regents, The University of Texas System. 

* cited by examiner 



U.S. Patent 


Apr. 1, 2014 


Sheet 1 of 8 


US 8,689,083 B2 


t f f 

\ i 

? fi/5 ; i 

^ A \i V 

\ AA'A 

)t'k 

0 •? 0 • 0 ? 

1 S!' ; f 

1 VsJ ' 

i^u ihii mi 

41 41 41 

0 1 u 1 C' 1 


Ci>r>v 3 



Fia 1 

(Prior Art) 



LDPC part 



Fia2 

(Prior Art) 


Protograph-based LDPC code 



Protograph-based LDGM code Protograph-based LDGM code 


FIG. 3 

(Prior Art) 



U.S. Patent 


Apr. 1, 2014 


Sheet 2 of 8 


US 8,689,083 B2 


LOPG part 



A 

“so. 


0 1 
1 0 
2 2 
0 1 

0 0 
1 2 
2 1 
0 0 



0 0 
0 2 
2 1 
2 0 

to. O 






U.S. Patent Apr. l, 2014 sheet 3 of 8 US 8,689,083 B2 


0 1 2 
112 
2 2 2 
0 0 0 

0 0 1 
2 2 0 
1 2 1 
0 0 2 

0 0 1 
1 2 1 
2 1 2 
0 1 0 

0 0 2 
2 2 0 
1 1 2 
0 0 2 


riUs, o 

Threshold of the hew protograph ch^de family 


Code 
Rate J 

ProtograpB 
tlii'eshoid (dB) 

Cspacit>^ 
tteeshold (dB) 

Gap to 
capacity 

"ITT 1 

"5395 




Osi 

L059 

0.122 

.5/4 

L7€0 

1.626 

0.075 

"1F| 

2JT2 

■~“~~~~~~T640“ 

062™ 


2.445 

2.362 

0.083 

6/7 

2.702 

2.625 

0.077 


2.930 

2“S45 


8/9 

3.123 

3.042 

0.081 


3.2S8 

3.199 

0.089 


J I / 






U.S. Patent 


Apr. 1, 2014 


Sheet 4 of 8 


US 8,689,083 B2 




























U.S. Patent 


Apr. 1, 2014 


Sheet 5 of 8 


US 8,689,083 B2 



( 



0 

0 

0 





0 

0 

(3 

J ... 




0 

0 

0 




t) 

0 

(i 


0 0 '2 0 0 


¥'T"ir 

.1 

0 

(! 


0 !) 1 0 0 

1 0 1} 0 a 

i. 1 ! 

1 

1 

0 


^00210 

0 » i} 1 (> 

i 0 (i 

1 

i 

s 


m.. 






0 0 2 0 0 0 0 (i 0 (i 0 0 <) ], {) 0 


0 0 2 0 i :( 0 0 0 0 o o 
\ 0 0 2 0 1 (! !) 0 « 1 0 

( 




1 1 1 

i'i 1 1, 


!) 0 2 0 V> I 0 i 3 0 0 5. i.) 0 {} C: 

\ 0 0 2 0 1 0 0 0 0 (> (} 1 0 (S 0 0 


I 0 (! 

I 0 0 

I 0 0 

I 0 0 

I a 0 

I « 0 

I 0 0 

I I (> 
i i 

n 0 

0 
0 
0 
0 
s 0 
i) 
0 
0 
I 
0 


/ 1V-> 




/ 



1 0 

0 \ 




1 0 
i y 

0 

0 




i 0 
i 0 

5) 

y 




1 0 

y 




1 0 

y 




i 0 

0 




1 y 

0 




1 0 

y 

0 0 i 

’ 0 0 0 0 :i 0 0 0 1 0 0 5 

> 0 i 

i 0 n. 

0 

^ 0 0 ; 

: 1 i) 0 ^ 0 0 0 0 0 1 0 y i 

> 0 1 

? 0 M> 



FIG. 9 



U.S. Patent 


Apr. 1, 2014 


Sheet 6 of 8 


US 8,689,083 B2 


/ 




\ 


3/4 


f 0.583 


lh.42 


' 1/3 


i/|/2 ^ 


0 2 0 0 0 
y 

0 0 0 c 

U! 

^^2/3 

10 2 1 

1 / 
\ 

; 

i 

1 

C) 0 1 0 

jTi 

•^‘^6.583 

D C) 1 i 

) 0 / 
\ 

\ 0 2 1 0 
/ 

0 0 0 1 
ffl/2 

0 0 0 

) 0 / 
\ 

\ 0 2 2 0 t 

} 0 C) 0 i 

fjf 

^0.42 

;) i 0 ( 

rT/ 

\ 

\ 0 2 2 0 C 
\ 

) 0 (1 0 
FIG. 11 

] 1 0 1 

nr; 



U.S. Patent 


Apr. 1, 2014 


Sheet 7 of 8 


US 8,689,083 B2 


Code 

Rate 

Pt'OTograph 
Ihieslioid (dB) 

j Capacity' 

thresiioid (dB) 

Gt5p to 
capacity 

3/4 

1.701 

1.626 

0.075 

2/3 

U57 

1,059 

0,098 

0,583 

0.779 

0,590 

0.189 

1/2 

0.441 

0.187 

0.254 

0.417 

0.206 

-0.185 

0.391 

1/3 

-0.209 

-0.497 

L 

0.288 



I 

I iiK,: 

>-•1 


• I/' 


/■ 


Ki/ 


Si«? l:D9«xSrgU;»«2 


DispJ.DKiiSngU'ss; 5 


FIG. 13 



U.S. Patent 


Apr. 1, 2014 


Sheet 8 of 8 


US 8,689,083 B2 



FIG. 14 



FIG. 15 



US 8,689,083 B2 


1 

RATE-COMPATIBLE PROTOGRAPH LDPC 
CODES 

CROSS-REFERENCE TO RELATED 

APPLICATIONS 5 

The present application claims priority to U.S. Provisional 
Application 6 1 /3 5 5,050 filed on Jun. 15,2010, which is incor- 
porated herein by reference in its entirety. 

to 

STATEMENT REGARDING FEDERALLY 
SPONSORED RESEARCH OR DEVELOPMENT 

The invention described herein was made in the perfor- 
mance of work under a NASA contract, and is subject to the 15 
provisions of Public Law 96-517 (35 USC 202) in which the 
Contractor has elected to retain title. 

BACKGROUND 

20 

1. Field 

The present disclosure relates to constructing low-density 
parity-check (LDPC) codes from small template graphs 
called protographs. More in particular, it relates to methods 
for designing rate-compatible families of protographs of dif- 25 
ferent rates, where a code at one rate is used as an original 
code and alternative rate codes are obtained by extending, 
puncturing, or performing other operations on the original 
code. Constraints on the resulting parity check matrices are 
used to ensure that the resulting alternative rate codes provide 30 
good performance. 

2. Description of Related Art 

DEFINITIONS 

35 

As known to the person skilled in the art and as also 
mentioned in U.S. Pat. No. 7,343,539 incorporated herein by 
reference in its entirety, a low-density parity-check (LDPC) 
code is a linear code determined by a sparse parity-check 
matrix H having a small number of 1 s per column. The code’s 40 
parity-check matrix H can be represented by a bipartite Tan- 
ner graph wherein each column of H is represented by a 
transmitted variable node, each row by a check node, and each 
“1” in H by a graph edge connecting the variable node and 
check node that correspond to the column-row location of the 45 
“1”. The code’s Tanner graph may additionally have non- 
transmitted variable nodes. Each check or constraint node 
defines a parity check operation. Moreover, the fraction of a 
transmission that bears information is called the rate of the 
code. An LDPC code can be encoded by deriving an appro- 50 
priate generator matrix G from its parity-check matrix H. An 
LDPC code can be decoded efficiently using a well-known 
iterative algorithm that passes messages along edges of the 
code’s Tanner graph from variable nodes to check nodes and 
vice-versa until convergence is obtained, or a certain number 55 
of iterations is reached. 

A protograph is a Tanner graph with a relatively small 
number of nodes, connected by a small number of edges, 
allowing multiple parallel edges between two nodes. Each 
edge is a type. Thus, the number of total edges represents the 60 
number of types that exists in the protograph. A protograph 
code (an equivalent LDPC code) is a larger derived graph 
constructed by applying a “copy-and-permutation” operation 
on a protograph. The protograph is copied N times, then a 
large LDPC code graph is obtained by permuting N variable- 65 
to-check pairs (edges), corresponding to the same edge type 
of the original protograph. The resulting protograph code has 


2 

N times as many nodes as the protograph, but it has the same 
rate and the same distribution of variable and check node 
degrees. Thus, the degree distribution of a protograph-based 
LDPC code is the same as that of the protograph. A simple 
example of a protograph is shown in FIG. 1. This graph 
consists of 3 variable nodes and 2 check nodes that are inter- 
connected by 6 different edge (variable-to-check) types. The 
derived graph is constructed by replicating the protograph 3 
times, and permuting variable-to-check pairings within the 
same edge type of the protograph. A protograph can also be 
represented by a proto-matrix. For example, the proto-matrix 
of the protograph shown in the left portion of FIG. 1 has the 
following form: 



where the rows and columns represent the check nodes and 
variable nodes in the graph respectively. The elements in the 
matrix are the number of parallel edges that connect the 
variable node and the check node associated with their posi- 
tions. One way to construct larger codes is to replace each 
integer j in the proto-matrix with sum of j different NxN 
permutation matrices. If the integer is 1 , it would be replaced 
with 1 NxN pemiutation matrix. Another way is to first 
expand the protograph by a small factor such that the H matrix 
for the resulting expanded protograph does not contain any 
integer larger than 1 . Then each integer 1 in the H matrix will 
be replaced with an NxN permutation matrix. The assigned 
NxN permutations can be any type of permutations, including 
circulant permutations. An NxN identity matrix can be 
regarded as a trivial permutation matrix. If the NxN permu- 
tation is a circulant permutation, then define matrix X as one 
circular shift of the identity matrix to the left. Using this 
notation, then all circulant permutations can be represented 
by X', for i=0, 1 , . . . , (N- 1 ) . The selection and assignment of 
permutation matrices to construct N times larger LDPC code 
can be based on enlarging the smallest loop size in the 
expanded graph. Other optimization methods include Pro- 
gressive Edge Growth (PEG) for circulant matrices (see, for 
example X. Hu, E. Eleftheriou, and D. M. Arnold, “Regular 
and irregular progressive edge-growth tanner graphs,” IEEE 
Transactions on Information Theory, Vol. 51, issue 1, 2005, 
pp. 386-398), or the Approximate Cycle Extrinsic message 
degree (ACE) algorithm (see, for example, T. Tian, C. R. 
Jones, J. D. Villasenor, and R. D. Wesel, “Selective avoidance 
of cycles in irregular LDPC code construction,” IEEE Trans- 
actions on Communications, Volume 52, Issue 8, 2004, pp. 
1 242-1247, or T. Tian, C. R. Jones, J. D. Villasenor, and R. D. 
Wesel, “Construction of irregular LDPC codes with low error 
floors,” IEEE International Conference on Communications, 
2003, Vol. 5, pp. 3125-3129). So, in the case of circulant 
permutations, these optimization algorithms can be applied to 
obtain powers of X in the H matrix of the expanded proto- 
graph. 

The rate of a protograph is defined to be the lowest (and 
typical) rate of any LDPC code constructed from that proto- 
graph. All LDPC codes constructed from a given protograph 
have the same rate except for possible check constraint degen- 
eracies, which can increase (but never decrease) this rate and 
typically occur only for very small codes. Since the proto- 
graph serves as a blueprint for the Tanner graph representing 
any LDPC code expandable from that protograph, it also 
serves as a blueprint for the routing of messages in the itera- 
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live algorithm used to decode such expanded codes through a 
permutation per each edge type. The rate of a protograph code 
is computed as follows: 

n-m 

n - no 

where n and m are number of variable nodes and check nodes 
respectively in the protograph, ng is number of punctured 
(untransmitted) variable nodes. 

Excluding check nodes cormected to degree-1 variable 
nodes, applicants have proved that the number of degree-2 
nodes should be at most one less than the number of check 
nodes provided that no loop exists in the graph between 
degree-2 nodes and the checks connected to these nodes for a 
protograph to have the linear minimum distance property. A 
given protograph is said to have the linear minimum distance 
property if the typical minimum distance of a random 
ensemble of arbitrarily large LDPC codes built from that 
protograph grows linearly with the size of the code, with 
linearity coefficient which can be denoted by (see S. 

Abu-Surra, D. Divsalar and W. Ryan, “On the existence of 
typical minimum distance for protograph-based LDPC 
codes,” in Information Theory and Applications Workshop 
(ITA), January 2010, pp. 1-7). 

The iterative decoding threshold of a given protograph is 
similarly defined with respect to this random ensemble of 
LDPC codes as the lowest value of signal-to-noise ratio for 
which an LDPC decoder’s iterative decoding algorithm will 
find the correct codeword with probability approaching one 
as the size of an LDPC code built from that protograph is 
made arbitrarily large. Iterative decoding thresholds can be 
calculated by using a reciprocal charmel approximation (D. 
Divsalar, S. Dolinar, C. R. Jones, and K. Andrews, “Capacity 
approaching protograph codes,” IFFE J. Select. Areas Com- 
munication, vol. 27, no. 6, pp. 876-888, August 2009) or the 
PEXIT method (see, for example, G. Liva and M. Chiani, 
“Protograph LDPC codes design based on EXIT analysis,” in 
Proc. IEEE GLOBECOM, November 2007, pp. 3250-3254). 
Thresholds can be lowered either by using precoding (a sub- 
graph of the protograph with degree- 1 nodes, check nodes 
connected to these degree- 1 nodes, and all edges connected to 
these checks and other variable nodes with at least one pimc- 
tured node) or through the use of at least one very high-degree 
node in the base protograph. A protograph is said to have a 
low iterative decoding threshold if its threshold is close to the 
capacity limit for its rate. 

A family of protographs of different rates is said to be 
rate-compatible with embedding or embedded rate-compat- 
ible if the protographs for different rates produce embedded 
codewords with the same information block-length. In other 
words, with the same input, the codeword of a high-rate code 
is embedded into the codeword of a lower-rate code. This 
property makes this family of protographs suitable for Hybrid 
Automatic Repeat Request (HARQ) applications. The rate- 
compatible families described in the present disclosure are 
rate-compatible with embedding and can be implemented 
within a common encoding/decoding infrastructure. 

The most common way of generating rate-compatible fam- 
ily of codes is puncturing, i.e., starting with a low-rate mother 
code and then selectively discarding some of the coded bits to 
arrive at higher rate codes. This approach is simple but is not 
free of problems. Specifically, (1) the mother code is opti- 
mally designed for low rates, so higher-rate punctured codes 
have a wider gap to capacity; and (2) the optimal low rate code 


4 

structure and puncturing patterns are designed separately, 
which is suboptimal. Even though it has been shown that 
puncturing can theoretically achieve the same gap to capacity 
as the mother code, in existing codes puncturing has 
5 increased the gap significantly. 

Code extension starts with a high-rate code (a daughter 
code), and then lower rate codes are obtained by extending the 
parity check matrix of the daughter code. A protograph code 
is an LDPC code that can be constructed from a small proto- 
matrix with a few elements. While previous works (N. Jacob- 
sen and R. Soni, “Design of rate-compatible irregular LDPC 
codes based on edge growth and parity splitting,” in Proc. 
IEEE Vehicular Technology Conference (VTC), 30 2007, Oct. 
3 2007, pp. 1052-1056 and references therein) are mainly 
designed for rate-compatible irregular LDPC codes with 
higlily optimized framework and unstructured design, rate- 
compatible protograph-based codes can achieve very good 
tlnesholds with low encoder complexity as well as fast decod- 
20 ing (D. Divsalar, S. Dolinar, C. R. Jones, and K. Andrews, 
“Capacity approaching protograph codes,” IEEE J. Select. 
Areas Communication, vol. 27, no. 6, pp. 876-888, August 
2009). Several protograph-based rate-compatible codes have 
been produced by El-Khamy at al. (M. El-Khamy, J. Hou, and 
25 N. Bhushan, “Design of rate-compatible structured LDPC 
codes for hybrid ARQ applications,” IEEE J. Select. Areas 
Commun., vol. 27, no. 6, pp. 965-973, August 2009 and 
references therein) whose design starts with a good proto- 
graph followed by puncturing or node splitting methods. 
30 These methods do not guarantee to cover all possible connec- 
tions in a graph structure, thus they result in higher decoding 
thresholds. 

Codes using a pre-accumulator and a punctured node were 
devised in Divsalar at al. (D. Divsalar, S. Dolinar, C. R. Jones, 
35 and K. Andrews, “Capacity approaching protograph codes,” 
IEEE J. Select. Areas Communications, vol. 27, no. 6, pp. 
876-888, August 2009). However, this code structure by itself 
is not sufficient for a rate-compatible family that must have 
the same information block size, otherwise it is not useful for, 
40 e.g., HARQ applications. The paper of Dolinar (S. Dolinar, 
“A rate-compatible family of protograph-based LDPC codes 
built by expurgation and lengthening,” in Proc. IEEE ISIT, 
September 2005, pp. 1627-1631) discusses the production of 
rate-compatible protograph codes based on node-splitting 
45 and attaching additional accumulators, but these codes are 
only available forrates higher than 1/2 and, furthermore, their 
gap to capacity can be improved upon. 

The present disclosure is related to the design method of 
protographs described in U.S. Pat. No. 7,343,539 and U.S. 
50 Patent Application Publication 2008/0294969. In these two 
disclosures, the design methods are mainly based on applying 
a node splitting or pre-coding technique from a given LDPC 
code. This teclmique does not take care of all possible edge 
cormections in a protograph structure and may result in pro- 
55 tograph codes with high gap to capacity limits. 

SUMMARY 

Described herein are embodiments that provide for digital 
60 cormnunication coding methods resulting in rate-compatible 
low density parity-check (LDPC) codes built from proto- 
graphs. Described digital coding methods start with a desired 
code rate and a selection of the numbers of variable nodes and 
check nodes to be used in the protograph. Constraints are set 
65 to satisfy a linear minimum distance growth property for the 
protograph. All possible edges in the graph are searched for 
the minimum iterative decoding threshold and the protograph 
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with the lowest iterative decoding threshold is selected. Pro- 
tographs designed in this manner may be used in decode and 
forward relay channels. 

An embodiment of the disclosed invention is a digital com- 
munication coding method, comprising: selecting a desired 5 
rate to be implemented by a low-density parity-check (LDPC) 
code represented by a protograph; selecting a number of 
variable nodes and a number of check nodes to be imple- 
mented in the protograph; selecting constraints for the proto- 
graph; searching for all possible edges in the protograph to to 
create computed permutations of the protograph; computing 
an iterative decoding threshold for each computed permuta- 
tion of the protograph; and selecting the protograph with a 
lowest computed iterative decoding threshold to implement 
the LDPC code. Constraints for the protograph may be 15 
selected to satisfy a linear minimum distance property. 

Another embodiment of the disclosed invention is a digital 
communication coding method for embedded rate-compat- 
ible LDPC codes comprising: selecting a higher rate code 
represented by a higher rate parity check matrix with a higher 20 
rate row dimension and a higher rate column dimension; 
constructing a protograph represented by a lower rate parity 
matrix, wherein the lower rate parity matrix is created by 
extending the higher rate parity matrix by an equal number of 
added columns and added rows, wherein the added columns 25 
and added rows form three submatrices within the lower rate 
parity matrix, a first submatrix of the three submatrices hav- 
ing a location within the lower rate parity matrix defined by 
the added columns and the higher rate row dimension, a 
second submatrix of the three submatrices having a location 30 
within the lower rate sub matrix defined by the added rows and 
the lower rate column dimension, and a third submatrix of the 
three submatrices having a location defined by the added 
columns and added rows, and wherein the first submatrix is a 
zero submatrix; constraining edges in the second and third 35 
submatrix to maintain linear growth of minimum distance; 
computing an iterative decoding threshold for each computed 
permutation of the protograph; and selecting the protograph 
with a lowest computed iterative decoding threshold to imple- 
ment an LDPC code. 40 

Another embodiment of the disclosed invention is a digital 
communication coding method for rate-compatible LDPC 
codes comprising: selecting a first rate code represented by a 
first rate parity check matrix; constructing a second rate parity 
check matrix by extending the first rate parity check matrix by 45 
one or more rows or one or more columns or one or more rows 
and columns; selecting constraints for a protograph resulting 
from the second rate parity check matrix; searching for all 
possible edges in the protograph to create computed permu- 
tations of the protograph; computing an iterative decoding 50 
threshold for each computed permutation of the protograph; 
and selecting the computed permutation of the protograph 
with a lowest computed iterative decoding threshold to imple- 
ment an LDPC code, wherein the implemented LDPC code 
comprises a code at a second rate. A constraint may be 55 
selected for the protograph to satisfy a linear minimum dis- 
tance property. The first rate code may be a high rate code and 
the first rate parity check matrix may be extended by adding 
one or more rows. The first rate code may be a low rate code 
and the first rate parity check matrix may be extended by 60 
adding one or more columns. 

Another embodiment of the disclosed invention is a 
method for transmission within a half-duplex relay channel 
having at least one relay, the method comprising: selecting a 
first LPDC code with a rate necessary to support transmission 65 
of source data from a source to a destination, wherein the first 
LDPC code is represented by a first protograph; adding one or 


6 

more second protograph variable nodes to the first protograph 
to create a second protograph wherein the second protograph 
has a linear distance property and the second protograph 
implements a second LDPC code; transmitting data from a 
source with the source data encoded with the second LDPC 
code; receiving data coded with the second LDPC code at a 
relay; decoding the data received at the relay to extract the 
second LDPC codeword; selecting a subset of the variable 
nodes of the second protograph and adding one or more 
variable and check nodes to create a third protograph, 
wherein the third protograph implements a third LDPC code; 
encoding the one or more variable nodes of the third LDPC 
code with a fourth LDPC code; transmitting from the relay the 
added one or more variable nodes coded with the fourth 
LPDC code to a destination; decoding data received at the 
destination to extract the added one or more variable nodes 
with the fourth LDPC code; decoding a subset of the data 
received at the destination that constitutes the third LDPC 
codeword to extract a subset of the second LDPC codeword 
that excludes the first LDPC codeword; decoding the remain- 
ing part of data received at the destination with the first LDPC 
code to extract the first LDPC codeword; the source data is 
extracted from the extracted second LDPC codeword at the 
destination. The second protograph preferably has a higher 
rate that constitutes a weaker code that is sufficient to support 
transmission of source data from the source to the relay. 

Another embodiment of the disclosed invention is a 
method for transmission within a half-duplex relay channel 
having at least one relay, the method comprising: selecting a 
first LPDC code with a rate necessary to support transmission 
of source data from a source to a relay, wherein the first LDPC 
code is represented by a first protograph; adding one or more 
check nodes and variable nodes to the first protograph to 
create a second protograph with a lower rate necessary to 
support transmission of source data from the source to a 
destination, wherein the second protograph has a linear dis- 
tance property and the second protograph implements a sec- 
ond LDPC code; transmitting data from the source with the 
source data encoded with the first LDPC code; receiving data 
coded with the first LDPC code at a relay; decoding the data 
received at the relay to extract source data coded with the first 
LDPC code; computing at the relay the added one or more 
variable nodes corresponding to the second LDPC code; 
encoding the computed one or more variable nodes with a 
third LDPC code; transmitting the computed one or more 
variable nodes coded with the third LDPC code to a destina- 
tion; decoding data received at the destination to extract the 
computed one or more variable nodes with the third LDPC 
code; and decoding data received at the destination using the 
computed one or more variable nodes to extract the source 
data from data received at the destination with the second 
LDPC code. 

Another embodiment of the disclosed invention is a 
method for transmission within a half-duplex relay channel 
having two or more relays, the method comprising: selecting 
a first LPDC code with a rate necessary to support transmis- 
sion of source data from a source to a first relay, wherein the 
first LDPC code is represented by a first protograph; adding 
one or more check and variable nodes to the first protograph 
to create a second protograph with a lower rate necessary to 
support transmission of source data from the source to a 
second relay, wherein the second protograph has a linear 
distance property and the second protograph implements a 
second LDPC code; adding one or more check and variable 
nodes to the second protograph to create a third protograph 
with a lower rate necessary to support transmission of source 
data from the source to a destination, wherein the third pro- 
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tograph has a linear distance property and the third proto- 
graph implements a third LDPC code; transmitting data from 
the source with the source data encoded with the first LDPC 
code; receiving data coded with the first LDPC code at a first 
relay; decoding the data received at the first relay to extract 5 
the source data coded with the first LDPC code; computing at 
the first relay one or more added first relay variable nodes in 
the second LDPC code; encoding the one or more added first 
relay variable nodes with a fourth LDPC code; transmitting 
from a first relay the one or more added first relay variable 
nodes coded with the fourth LPDC code; decoding data 
received at the second relay to extract the one or more added 
first relay variable nodes coded with the fourth LDPC code; 
decoding data received at the second relay using the extracted 
one or more added first relay variable nodes to extract the 
source data coded with the second LDPC code; computing at 
the second relay one or more added second relay variable 
nodes to produce a third LDPC codeword; encoding the one 
or more added second relay variable nodes with a fifth LDPC 20 
code; transmitting the fifth LDPC code from the second relay 
to a destination; decoding the fifth LDPC code at the desti- 
nation to extract the one or more added second relay variable 
nodes; decoding the fourth LDPC code at the destination to 
extract the one or more added first relay variable nodes; and 25 
decoding a destination message using the one or more added 
first relay variable nodes and the one or more added second 
relay variable nodes to extract the source data. 

BRIEF DESCRIPTION OF THE SEVERAL 30 

VIEWS OF THE DR-WINGS 

FIG. 1 shows an example of a protograph and demonstrates 
a copy-and-permute operation on the protograph to obtain a 
larger graph. The protograph also can be represented by a 
protomatrix whose elements present the number of edges 
connecting a variable node (column) to a check node (row) in 
the protograph. 

FIG. 2 shows a protograph of rate-I/2 AR4JA code (as 
reported in the U.S. Pat. No. 7,343,539 and U.S. Patent Pub- 
lication No. 2008/0294969). 

FIG. 3 shows a rate-I/2 protograph and its protomatrix 
whose iterative decoding threshold of 0.250 dB with a gap of 
only 0.063 dB to its relative capacity limit. 45 

FIG. 4 shows a rate-I/2 protograph and its protomatrix 
whose iterative decoding threshold of 0.395 dB with a gap of 
only 0.208 dB to its relative capacity limit and having linear 
minimum distance grow property. 

FIG. 5 and FIG. 6 show the protomatrices of high- 50 
rate (>I/2) protographs that extend from rate-I/2 protograph 
of FIG. 4. All protographs have linear minimum distance 
growth property. 

FIG. 7 shows the iterative decoding thresholds of all codes 
whose protomatrices are shown in FIG. 5 and FIG. 6. 55 

FIG. 8 shows embedded rate-compatible parity matrix 
structures and an extension method for those structures (for 
example, a rate-1/3 protograph is obtained by extending from 
a rate- 1/2 protograph) 

FIG. 9 shows protomatrices of rate-compatible family built 60 
from extending from rate-3/4 protograph whose protomatrix 
is shown in FIG. 5. 

FIG. 10 shows the iterative decoding thresholds of the 
rate-compatible protographs whose protomatrices are shown 
in FIG. 9. 65 

FIG. 1 1 shows the protomatrices of protographs that expur- 
gate from rate-3/4 code given in FIG. 5. 
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FIG. 12 shows the iterative decoding thresholds of the 
expurgated protographs whose protomatrices are shown in 

FIG. 11. 

FIG. 13 shows the application of lengthening protograph 
design given in FIG. 5 and FIG. 6 in one-relay half-duplex 
channel. 

FIG. 14 shows the application of expurgating protograph 
design given in FIG. 9 in one-relay half-duplex channel. 

FIG. 15 shows the application of expurgating protograph 
design given in FIG. 9 in two-relay half-duplex channel. This 
can be extended to multiple relay channels. 

DETAILED DESCRIPTION 

The method of the present disclosure provides that a simple 
search of all possible edge connections in a protograph struc- 
mre results in a protograph having smaller gap to capacity 
compared with those codes reported in these two patents . The 
resulting protograph codes can be implemented by similar 
encoding method in the U.S. Pat. No. 7,499,490. 

The codes constructed in accordance with the methods 
described in the present disclosure may fall into three catego- 
ries. Each can find applications in different scenarios. The 
three categories are: (1) LDPC codes built from individual 
protographs having the linear minimum distance property 
and low iterative decoding threshold close to the capacity 
limits for their respective rates; (2) Rate-compatible families 
of LDPC codes for adaptive coding and/or the relay channel 
built from a family of protographs of different rates all having 
the linear minimum distance property within a common 
encoding/decoding infrastructure; (3) Rate-compatible fami- 
lies of LDPC codes with the same information block size, 
suitable for HARQ applications, built from a family of pro- 
tographs of different rates all having the linear minimum 
distance property within a common encoding/decoding infra- 
structure. 

Design of Rate- 1/2 Protograph 

A well-known protograph family, the AR4JA family, fol- 
lows the structure with a degree- 1 node (see FIG. 2). This 
family of codes is simple and powerful and has iterative 
decoding thresholds close to capacity (about 0.4 dB). It also 
enjoys linear growth of minimum distance with codeword 
length. In the AR4JA rate-compatible structure, the rate-1/2 
code is designed first, and then the additional variable nodes 
are added to create liigher rate codes. The structure of the 
rate-1/2 code is shown in FIG. 2 as a concatenation of a 
pre-coder (degree- 1 part or a rate-1 accumulator) with an 
LDPC. The proto-matrix of the rate- 1/2 AR4JA protograph is: 
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Using the PEXIT technique, this rate-1/2 code has the 
threshold of 0.6337 dB. The LDPC protograph subgraph, i.e., 
the two rows in the right-bottom part of above equation, 
consists of only two check nodes. Following the linear mini- 
mum distance criteria described above, there is only one 
degree-2 variable node allowed in the protograph structure. A 
higher-rate code is generated by adding two additional 
degree-3 variable nodes. 

Although it is a good code, the AR4 JA code has not been 
designed by a systematic search of the design space and 
therefore it can be improved upon. Described below is a 
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method for a systematic and efficient search of the design 
space that finds better codes with lower iterative decoding 
thresholds. 

The basic design procedure has the following steps: 1) Start 
with a desired code rate; 2) Determine how many variable 5 
nodes and check nodes needed in the protograph; 3) Set a list 
of constraints in order to satisfy linear minimum distance 
growth; 4) Search for all possible edges in the graph and 
compute iterative decoding threshold for each case; and 5) 
Select the graph that offers the lowest iterative decoding to 
threshold. 

To clarify this method, first consider the following example 
for the design of a rate- 1/2 protograph code. A simple proto- 
graph structure which has 7 variable nodes (of which the third 
node is punctured) and 4 check nodes will be the starting point 15 
for this example. The rate R of the proposed protograph is as 
follows: R=(7-4)/(7-l)=3/6=l/2. A punctured variable node 
has been included since it has been observed that punctured 
(un-transmitted) variable nodes can improve performance 
(see, for example, T. Richardson and R. Urbanke, “Multi- 20 
edge type LDPC codes,” Tech. Rep. 2004; A. Abbasfar, D. 
Divsalar, and K. Yao, “Accumulate-repeat-accumulate 
codes,” IEEE Trans. Commun., vol. 55, no. 4, pp. 692-702, 
April 2007). The protograph may also be represented by its 
4x7 proto-matrix. This proto-matrix contains 28 elements 25 
that indicate how many parallel edges connect equivalent 
check and variable nodes in the protograph structure. Opti- 
mization over these 28 variables is computationally complex 
and the finding of the optimum in a high-dimensional terrain 
is difficult, therefore adjustments to this optimization prob- 30 
lem are necessary to make a practical solution viable. 

One degree- 1 variable (one column of weight- 1), and one 
degree-2 variable (column of weight-2) are so far instituted. 
Therefore the protomatrix up to this point is: 
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The variables x and y designate the remainder of the pro- 
tograph to be designed. The overall code is effectively the 
concatenation of a Tow Density Generator Matrix (LDGM) 45 
code (first row and column) with an TDPC code (columns 2 
through 7, rows 2 through 4). The linear minimum distance 
growth only involves the TDPC part. Therefore all the com- 
ments in the remainder of this paragraph are focused on this 
submatrix. To have linear minimum distance growth (see S. 50 
Abu-Surra, D. Divsalar and W. Ryan, “On the existence of 
typical minimum distance for protograph-based LDPC 
codes,” in Information Theory and Applications Workshop 
(ITA), January 2010, pp. 1-7), the number of degree-2 nodes 
in the LDPC protograph must be limited to the number of 55 
check nodes in the LDPC part minus 1, that is 3-1=2. So no 
more than two degree-2 nodes can be used, i.e., the number of 
degree-2 nodes can be either one or two. Furthermore, 
degree-2 nodes cannot form a cycle among themselves. 

Other variable nodes within the LDPC part of the matrix 60 
must have degree at least 3 except one highest degree node, 
therefore the sum of columns designated as x, except for 
degree-2 nodes, must be 3 or higher. To limit the search space, 
the maximum number of parallel edges in the protograph is 
constrained. Via experiments, it has been observed that 65 
increasing the number of parallel edges beyond a certain point 
is not useful. The reason is that subject to a given code length. 


increasing the number of parallel edges will increase the 
likelihood of short cycles. For the third node (column), the 
maximum number of parallel edges is set to 3. Forthe remain- 
ing nodes, the maximum number of parallel edges is set to 2. 
These constraints reduce both the dimensionality of the 
search space as well as the breadth of the discrete search in 
each dimension, making a systematic search viable. The 
result of optimization for this particular example is as fol- 
lows: 
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The threshold of this code is 0.395 dB which shows a gap 
of 0.208 dB of capacity, less than that of the rate-1/2 AR4JA 
code described in U.S. Pat. No. 7,343,539. The new proto- 
graph is shown in FIG. 4 . 

If the linear minimum distance growth criteria is not 
imposed, the optimization procedure yields a protograph with 
a lower threshold that has a proto-matrix as follows: 
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This code has a threshold of 0.250 with a gap of only 0.063 
dB to capacity. While this may be the best iterative decoding 
threshold reported for a structured (non-random) code in the 
literature, but it does not mean it is a good code. In fact, this 
is the concatenation of two LDGM codes (the first column- 
row; and last column-row) with one LDPC code (correspond- 
ing to the middle sub-matrix) as shown in FIG. 3 . Therefore 
the minimum distance of this code does not grow linearly 
with codeword length and it may suffer from an error floor. 
The LDPC subgraph has too many degree-2 variable nodes (3 
degree-2 variables and 2 checks) which violate the condition 
for linear minimum distance as described in S. Abu-Surra, D. 
Divsalar and W. Ryan, “On the existence of typical minimum 
distance for protograph-based LDPC codes,” in Information 
Theory and Applications Workshop (ITA), January 2010, pp. 
1-7. 

Design of High Rate Protograph Codes by Lengthening 

The discussion above focuses on rate- 1/2 protograph 
codes. Designing higher rate protographs is more difficult 
because the proto-matrix contains many more elements than 
those of a rate-1/2 protograph. In the discussion below, a 
simple approach to overcome this difficulty is described. 
Codes whose iterative decoding thresholds are close to capac- 
ity are produced. These codes reside within a family of codes 
that has a nested structure and offers a range of rates with a 
common encoder and decoder infrastructure. A family of 
high-rate protograph codes is constructed from a low-rate 
protograph by code lengthening, i.e., by lengthening the par- 
ity matrix of a lower-rate code (a base code) in the form of 
. Hj is the parity check matrix of the low -rate 
code and is an extension matrix. 

Several families of nested protograph codes based on code 
lengthening have been reported in the literature using node 
splitting and permutation of the edges in an ad hoc manner 
that is not feasible to generalize to various mother codes and 
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various rates. See, for example, D. Divsalar, S. Dolinar, C. R. 
Jones, and K. Andrews, “Capacity approaching protograph 
codes,” IEEE J. Select. Areas Commun., vol. 27, no. 6, pp. 
876-888, August 2009, and A. Abbasfar, D. Divsalar, and K. 
Yao, “Accumulate-repeat-accumulate codes,” IEEE Trans. 5 
Commun., vol. 55, no. 4, pp. 692-702, April 2007. Therefore, 
there is motivation in devising a systematic approach for the 
design of nested protograph codes. 

Described below is an example for the design of high-rate 
codes with rate R=(n+l)/(n+2) for n=l, 2 ... as an extension 
of the optimized rate-1/2 protograph shown in FIG. 4 . These 
codes have a minimum distance that grows linearly with code 
length. Similar to the previous section, the search space for 
the target code is described in the following way: . , 
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where variables y in the first row correspond to the check node 
that connects to the degree- 1 variable node. Variable x in rows ^5 
2-4 constitute the extension to the LPDC subgraph. In order to 
preserve the linear growth of minimum distance for the new 
high rate codes, the column sums in the LDPC subgraph, 
namely sums of columns designated with variable x, should 
be 3 or higher. This constraint ensures that all variables in the 30 
LDPC part of the extension structures have degreeaS. The 
problem may be simplified by setting the maximum number 
of parallel edges to 2 (i.e. x, y=0, 1, 2). The result of optimi- 
zation for this particular example is shown in FIG. 5 and FIG. 

6. The iterative decoding thresholds of these codes are given 35 
in FIG. 7. For rates>2/3, the produced codes have decoding 
thresholds within 0.09 dB of capacity, and the rate- 2/3 code 
has a threshold within 0.122 dB of capacity. 

Design of Rate-Compatible Protograph Codes for HARQ 
Applications 40 

Note that, in the family of nested codes described above, 
the information block-lengths of the nested codes are not 
identical. The same is true of AR4JA codes. Thus, these codes 
are not suitable for HARQ applications. Several works in the 
literature present designed irregular LDPC codes for HARQ 45 
applications using puncturing and code extension where the 
code design typically requires painstaking optimization. See, 
for example, N. Jacobsen and R. Soni, “Design of rate-com- 
patible irregular LDPC codes based on edge growth and par- 
ity splitting,” Proc. IEEE Vehicular Technology Conference 50 
{VTQ, 2007, pp. 1052-1056; J. Li and K. R. Narayanan, 
“Rate-compatible low density parity check codes for capac- 
ity-approaching ARQ schemes in packet data communica- 
tions,” Proc. CUT, November 2002; M. R. Yazdani and A. H. 
Banihashemi, “On construction of rate compatible low-den- 55 
sity parity-check codes,” IEEE Commun. Lett., Vol. 8, no. 3, 
pp. 159-161, March2004; J. Ha, J. Kim, and S. McLaughlin, 
“Rate-compatible puncturing of low density parity-check 
codes,” IEEE Trans. Inform. Theory, Vol. 50, No. 11, pp. 
2824-2836, November 2004; and H. Pishro-Nik and F. Fekri, 60 
“Results on punctured LDPC codes,” Proc. IEEE Information 
Theory Workshop, October 2004, pp. 215-219. Furthermore, 
the encoders for these codes are unstructured and, therefore, 
are computationally complex. In contrast, codes that can be 
represented by protographs with a circulant permutation per 65 
edge type structure are generally more desirable for ease of 
encoder and decoder implementation. 


M. El-Khamy, J. Hou, and N. Bhushan, “Design of rate- 
compatible structured LDPC codes for hybrid ARQ applica- 
tions,” IEEE J. Select. Areas Commun., vol. 27, no. 6, pp. 
965-973, August 2009, describe the design of rate-compatible 
protograph LDPC codes by first extending and randomly 
pruning from an existing protograph to produce a low-rate 
code, and then obtaining other high-rate codes by puncturing 
this low-rate code. As described above, puncturing has sev- 
eral weaknesses and usually results in codes that have itera- 
tive decoding thresholds with a wider gap to capacity than 
that of the low-rate mother code. However, the weaknesses of 
puncmring can be avoided by using a code extension 
approach, as described below. 

New rate-compatible family of codes can be constructed by 
extending the parity matrix H of a high-rate protograph code 
by an equal number of columns (variable nodes) and rows 
(check nodes). Since the data block size is proportional to the 
difference between the number of variable and check nodes, 
this will ensure that the new code will have the same data 
block size. This idea is illustrated in FIG. 8. In FIG. 8, the 
parity check matrix H^/j of the rate-1/3 code is obtained by 
extending that of the rate-1/2 code. The parity check matrix 
Hj /4 of the rate-1/4 code is again extended from that of the 
rate-1/3 code. This structure forms a nested family of rate- 
compatible codes . Hie zero submatrices ensure that the incre- 
mental variable nodes are indeed new parity bits that are 
purely determined by the new parity check equations and are 
not affected by the parity check equations of the higher-rate 
code. This is necessary to guarantee that the high-rate code is 
nested inside the low-rate code. 

One construction of a nested rate-compatible family of 
codes is presented below as an exemplary embodiment. How- 
ever, the proposed method is completely general; one can 
start from any high-rate code to build a successive set of 
lower-rate codes. The starting point for the following con- 
struction is the rate-3/4 protograph code whose proto-matrix 
is described in FIG. 5. Since an equal number of columns and 
rows are added to the proto-matrix, the lower-rate codes 
obtained from the rate-3/4 code above have rates R=(13-4)/ 
(13-l+N)=9/(12+n) where n is the number of checks and 
variables added. For each value of n, the new code will require 
a search. As a representative sample, an example of the search 
for n=3 is presented, which yields a rate-0. 6 code. The search 
space for tliis new code is in the form: 
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The problem is to find edges that connect the old graph (the 
rate-3/4 code) to 3 new check nodes and variable nodes. The 
unknown edges are represented with variables x, y and z, 
which are divided into two types. The first edge type is the 
ones that coimect the variables of the old graph to new checks, 
denoted by x and y, where variables y are edges connecting to 
the highest degree variable node in the old graph, and vari- 
ables x are the remaining edges connecting to the rest of old 
variables except degree-1 node. The other type consists of 
edges that connect the new variable nodes to the new check 
nodes, denoted by variable z in the right -bottom comer sub- 
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matrix. In order to maintain linear growth of minimum dis- 
tance, more care is needed in this case since degree-2 vari- 
ables that form short cycles may arise. Therefore the problem 
may be further simplified by setting this submatrix to be a 
lower triangular. 5 

The optimization process is simplified by further limiting 
the maximum number of parallel edges. For example, y can 
be set to the values of 1 , 2, x and z to the values of 0, 1 . The 
resulting family of rate-compatible codes has proto-matrices 
given in FIG. 9. The thresholds of the new rate-compatible 
codes are shown in FIG. 10. As seen in the table, these codes 
have thresholds uniformly within 0.1 dB of their capacity 
limits. All the codes have linear minimum distance property. 
Design of New Protograph Codes by Expurgating a High- 
Rate Protograph 

A new family of protographs can also be designed by 
expurgating a high-rate protograph, i.e. to add several addi- 
tional parity checks into an existing high-rate protograph to 
produce a lower-rate protograph code. This approach has 
applications in multi-node scenarios, i.e. the relay chamiel 
discussed below. The resulting protograph is called an expur- 
gated protograph code. 

A new expuigated protograph is designed by following 
structure: 



where is the parity check matrix or protomatrix of a high- 
rate protograph, is additional check matrix (check nodes) 
need to be designed based on existing structure of Hj. 

Described below is an example of designing a family of 
expurgated protographs based on a rate-3/ 4 protograph which 35 
is one member of lengthening protograph family shown in 
FIG. 5. Applying the same above design procedure, the new 
family of protographs is shown in FIG. 11. The iterative 
decoding thresholds of the new expurgated protograph codes 
are shown in FIG. 12. As seen in the table, these codes have 40 
thresholds within 0.4 dB of their capacity limits. All the codes 
have linear minimum distance property. 

Application of Lengthening Protograph Codes and Expur- 
gated Protograph Codes in Decode-and-Forward Half-Du- 
plex Relay Channel 45 

Relay channels describe a network scenario where the 
source transmits its data to the destination with the help of one 
or more nearby relays. This cooperative scheme is an effec- 
tive solution for up-coming high throughput wireless systems 
(e.g. LTE, 4G) by providing an additional spacial gain, 50 
namely user cooperation diversity (see, for example; A. Sen- 
donaris, E. Erkip, and B. Aazhang, “User cooperation diver- 
sity. Part I: System Description,” ZEEi? Trans. Commun., vol. 

51, no. 11, pp. 1927-1938, November 2003; and A. Sendon- 
aris, E. Erkip, and B. Aazhang, “User cooperation diversity. 55 
Part II. implementation aspects and performance analysis,” 
IEEE Trans. Commun., vol. 51, no. 11, pp. 1939-1948, 
November 2003), or cooperative diversity (see, for example, 

T. Hunter and A. Nosratinia, “Cooperation diversity through 
coding,” Proc. IEEE ISIT, June 2002, p. 220; J. Laneman, D. 60 
Tse, and G. Wornell, “Cooperative diversity in wireless net- 
works: Efficient protocols and outage behavior,” IEEE Trans. 
Inform. Theory, vol. 50, no. 12, pp. 3062-3080, December 
2004; and J. Laneman and G. Wornell, “Distributed space- 
time-coded protocols for exploiting cooperative diversity in 65 
wireless networks,” IEEE Transactions on Information 
Theory, vol. 49, no. 10, pp. 2415-2425, October 2003). This 
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spacial gain comes from the nature of the wireless environ- 
ment among users in a wireless system. Those users are able 
to freely receive the source’s signal and then able to help the 
source to transmit at higher data rates to its taiget user. 
Though the capacity of a relay channel in general is unknown, 
many research progresses have been made. Relay protocols 
and their theoretic information capacity results have been 
extensively studied. See, for example, T. Cover and A. E. 
Gamal, “Capacity theorems for the relay channel,” IEEE 
Trans. Inform. Theory, vol. 25, no. 5, pp. 572-584, September 
1979, and G. Kramer, M. Gastpar, andR Gupta, “Cooperative 
strategies and capacity theorems for relay networks,” IEEE 
Trans. Inform. Theory, vol. 51, no. 9,pp. 3037-3063, Septem- 
ber 2005. 

Although significant progress has been made in the relay 
coding problem, existing LDPC codes must be painstakingly 
optimized to match to a single set of channel conditions, 
many of them do not offer easy encoding, and most of them do 
not have structured design. The application of protograph 
codes in the relay channel address three important issues in an 
integrative manner: low encoding complexity, modular struc- 
mre allowing for easy design, and rate-compatibility so that 
the code can be easily matched to a variety of charmel con- 
ditions without extensive re-optimization. In addition, the 
proposed protograph codes offer excellent performance. 

One Relay Channel 

A half-duplex relay chamiel is shown in FIG. 13 and FIG. 
14 . For this example, only a decode-and- forward protocol is 
considered. X, and W, denote the transmitted signals from the 
source (S) and the relay (R) while and V; denote the 
received signals at the destination (D) and relay respectively. 
Subscript 1 denotes broadcast (BC) mode transmitted in the 
duration t, where t is a normalized time parameter taking 
values between zero (beginning of transmission interval) and 
one (end of transmission interval), and subscript 2 denotes the 
multiple access (MAC) mode transmitted in duration f=l-t. 

Where h^^, h^^ and h^^ are the S-to-R, S-to-D and R-to-D 
channel coefficients respectively, N^j, N^i and Nq 2 are the 
noise samples at the relay and the destination in broadcast and 
MAC modes, respectively. All noise samples are assumed to 
be Gaussian with zero mean and unit variance. 

An average system transmission power constraint is 
imposed on the nodes as: 

tP Sl+t{P s2+Pr2)^P 

where Psi =E[Xj^] represents the source transmission power 
in BC mode at duration t, similarly and represent the 
source and relay transmission powers in the MAC mode at 
duration t'=l-t, and P represents the total system transmis- 
sion power. From the system model, there are three links in 
the relay channel with two SNR levels: SNRl denotes the 
SNR level at the relay and SNR2 denotes the SNR level at the 
destination. The relay must decode the source signal at SNRl 
while the destination must decode the source signal at 
SNR2<SNR1 with the help of side information from the relay 
signal transmitted in the MAC mode. Thus the challenge of 
designing a coding scheme for the relay channel is how to 
optimize a code such that this code can optimally operate at 
two different SNRs or two different rates. 

As discussed from the previous paragraph, the main prob- 
lem of half-duplex relay coding can be reduced to the simul- 
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taneous design of two codes that operate at two different rates 
(or two different SNRs), such that one is a subset of the other. 
This problem can be addressed by forceful optimization, but 
two clever methods of addressing this problem are via the 
bilayer-expurgated (BE) and bilayer-lengthened (BL) LDPC 5 
structures . These methods use a bilayer Tarmer graph to make 
the two codes, while using a concept of “parity forwarding” 
with subsequent successive decoding that removes the need 
to directly address the issue of uneven SNRs among the 
symbols of a given codeword. The methods are attractive in to 
that they address some of the main issues in the design of relay 
codes, but the methods do not give rise to highly structured 
codes with simple encoding, nor do they provide rate-com- 
patible codes. 

A class of structured codes can be constructed that simul- 15 
taneously possess a bilayer parity-forwarding mechanism, 
while also benefiting from the properties of protograph codes 
(easy encoding, modular design, and rate-compatible). 
Described below is a method to construct a bilayer code that 
is applicable to the relay channel, using different protograph- 20 
based LDPC codes. Note that the design of good protograph- 
based LDPC codes that may be used in this application has 
been discussed above. 

A first method is a bilayer-lengthened approach. The 
bilayer lengthened code constructed for the half-duplex relay 25 
channel is shown in FIG. 13. This method consists of design- 
ing a low-rate protograph code (Layer 1) designed for the S-D 
channel (CSDl) and then adding a set of extra variable nodes 
(Layer 2) into layer 1 to form a higher rate bilayer code that is 
applicable for the S-R channel (CSRl). The codeword (both 30 
layers) CSRl is broadcast from the source (see FIG. 13). In 
the example of this figure, Layer 1 consists of a rate-1/2 code 
(seen again on the right side of the figure entitled “Step 2: 
Decoding Layer 1” and Layer 2 consists of up to 2n variable 
nodes. The relay receives this code and since this overall code 35 
is designed forthe S-R channel, will be able to decode it. Then 
the relay will generate an extra set of parity bits by using a 
code Cl only for Layer 2, in a manner similar to that described 
in P. Razaghi and W. Yu, “Bilayer low-density parity-check 
codes for decode-and-forward in relay channels,” IEEE 40 
Trans. Inform. Theory, vol. 53, no. 10, pp. 3723-3739, Octo- 
ber 2007, then the relay encodes and transmits it to the des- 
tination via a another code CRD2 . The extra parity bits will be 
decoded at the destination via a separate code Cl. Once the 
destination decodes this secondary code Cl, its bits can be 45 
eliminated from the Tanner graph of the first code to give rise 
to a lower-rate code that can be directly decoded at the SNR 
of the S-D link. These operations are depicted in FIG. 13. 

The design process for a variety of channel conditions is 
now very easy. Assume that the mother protograph code (the 50 
lower rate) is designed and is available. This mother code can 
then be used to choose the code with rate necessary to support 
transmission in the S-D link. This is the code demonstrated at 
the right side noted by “Layer 1” of FIG. 13. Another set of 
variable nodes are added into the graph of the mother code by 55 
considering the SNR of the S-R link. Both layers will form a 
bilayer code with a rate that is supported by the SNR of the 
S-R link as in the left side of FIG. 13. Another code (second- 
ary code) is used at the relay to generate additional parity bits 
for the Layer 2, and then forward these parity bits to the 60 
destination by using another code (third code). For the sec- 
ondary code, a systematic version of (another) rate-compat- 
ible protograph codebook may be used, which can be 
matched to the S-D channel quality. 

Another method is a bilayer-expurgated approach. The 65 
bilayer expurgated code constructed for the half-duplex relay 
channel is showed in FIG. 14. In contrast to the bilayer- 
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lengthened approach, the method consists of designing a 
high-rate code (CSRl) that is supported by the source-relay 
channel and then adding several check nodes into this code 
graph such that the overall graph (after adding these check 
nodes to form CSDl) has a lower rate that is supported by the 
source-destination channel. The codeword of the high-rate 
code CSRl is broadcast from the source (FIG. 14). The relay 
receives this code and since this code is designed for the S-R 
channel, will be able to decode it. Then, the relay will gener- 
ate an extra set of k2 parity bits (or equivalent check nodes in 
Layer 2), denoted as Layer 2 in FIG. 14. These extra parity 
bits are transmitted to the destination through another con- 
ventional code CRD2, designed to match with the R-D chan- 
nel. Once the destination decodes CRD2 to get these extra 
parity bits, it will be able to decode the source codeword using 
the bilayer graph at a lower rate CSDl at the SNRl level of the 
S-D channel. The operations are described in FIG. 14. 

Two Relay Channels 

So far, the discussion above concentrates on designing a 
coding scheme for the one-relay channel. However, the 
nested code strucmre can be also directly applied for the 
multi-relay channel scenarios. To illustrate that idea, an 
example of designing two-relay coding scheme is discussed 
in the following. There are two main different protocols that 
can be applied to the two-relay channel scenarios. In the first 
case, two relays can directly decode the source signal, then 
two relay can cooperatively beamform additional informa- 
tion to the destination. This coding problem is fundamentally 
the same as the case of the one-relay channel. In the second 
case, one can assume that the channel between the first relay 
and the destination is weak; and one out of two relays cannot 
decode the source signal; however it still gets a stronger signal 
than that of the destination. Then it is able to cooperate with 
the other relay to transmit additional information to destina- 
tion. The discussion below addresses the second case. 

The two-relay channel is plotted in FIG. 15 using expur- 
gated structure design in FIG. 11. In FIG. 15, two relays R^ 
and R 2 successively help to transmit the data of the source S 
to the destination D. The transmission time is divided into 
three time slots, indexed by the subscript i=l , 2 and 3 . X,., 
and Q, denote the transmitted signals from the source (S) and 
two relays (R^ and R 2 ) while Y,., V,. and P,. denote the received 
signals at the destination (D) and two relays respectively. In 
the first time-slot, the source transmits information which is 
received by two relays and the destination. The first relay can 
decode it, however the second relay and the destination are 
unable to decode. In the second time-slot, the source and the 
first relay transmit the additional information to the second 
relay and destination. Again, only the second relay can 
decode the source data, but the destination cannot. In the third 
time-slot, the source and two relays transmit additional infor- 
mation to help the destination decode the whole source code- 
word. 

Among the two methods of constructing a bilayer code 
discussed herein, the bilayer lengthened structure is difficult 
to extend to multiple-relay scenarios because of short-block 
length problem. In the bilayer lengthened structure for the 
one-relay channel, the source codeword is split into two parts . 
The relay generates parity bits for one part, and transmits to 
the destination. Thus the bilayer lengthened code is equiva- 
lent to two short code-words that are decoded at the destina- 
tion. So if multiple relays are used, the blocklength of 
source’s codeword is split into many codewords. Because the 
overall codeword length is limited due to practical con- 
straints, the many divisions mentioned above produce indi- 
vidual codewords that are too short to provide good perfor- 
mance. 
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The bilayer expurgated codes, on the other hand, do not 
have the problem of short blocklength. With one long code- 
word transmitted from the source, multiple relays can gener- 
ate as many parity bits as the decoder needs to decode the 
source message. 5 

The multi-layer expurgated code construction for the two- 
relay network is shown in FIG. 15. It consists of a nested 
bilayer or a three-layer structure that simultaneously supports 
three different rates, all of which are capacity approaching. 
The source encodes its message using the code CSRl. The to 
first relay decodes the source’s message, generates k2 parity 
bits using the sub-graph denoted “Layer 2”, then encodes 
these parity bits using another conventional LDPC code Cl to 
send to the second relay. The second relay decodes the code 
Cl to get k2 parity bits and decodes the source message with 15 
the help of these k2 parity bits. Then it computes separate k3 
parity bits using the subgraph denoted “Layer 3” to be 
encoded by another conventional LDPC code C2. The desti- 
nation decodes C2, then Cl, and finally the source message 
with the help of k2+k3 additional parity bits from two relays. 20 
The achievable rate using the above strategy is a special case 
of the achievable rate described in L. L. Xie and P. R. Kumar, 
“An achievable rate for the multiple level relay channel,” 
IEEE Trans. Information Theory, vol. 51, no. 4, pp. 1348- 
1358, April 2005. 25 

The nested bilayer expurgated structure code designed in 
FIG. 11 can support multiple rates. All codes are capacity 
approaching with the iterative decoding threshold gap within 

0.3 dB to the capacity limit. The code design methodology 
described here can be very general, and applicable for mul- 30 
tiple relay networks. For example, if the source uses the 
rate-0.75 code to encode its message, then the first relay will 
decode the source code at R=0.75; the second relay, with the 
help of k2 parity bits, can decode the source message at any 
rate R=0.59; then the destination, with the help of k2+k3 35 
parity bits from two relays can decode the source message at 
any rate 0.5. 

The examples above generally show the use of selected 
codes as the mother code for the derivation of a lower rate or 
higher rate LDPC codes. However, those skilled in the art 40 
understand that the mother codes may comprise any of sev- 
eral LDPC codes selected for various characteristics. Those 
skilled in the art also understand that the mother codes may 
comprise codes having rates other than those specifically 
used as examples above. Therefore, the disclosed and claimed 45 
invention comprises mother codes of multiple rates and mul- 
tiple compositions. 

The foregoing Detailed Description of exemplary and pre- 
ferred embodiments is presented for purposes of illustration 
and disclosure in accordance with the requirements of the 50 
law. It is not intended to be exhaustive nor to limit the inven- 
tion to the precise form or forms described, but only to enable 
others skilled in the art to understand how the invention may 
be suited for a particular use or implementation. The possi- 
bility of modifications and variations will be apparent to 55 
practitioners skilled in the art. 

No limitation is intended by the description of exemplary 
embodiments which may have included tolerances, feature 
dimensions, specific operating conditions, engineering speci- 
fications, or the like, and which may vary between implemen- 60 
tations or with changes to the state of the art, and no limitation 
should be implied therefrom. In particular it is to be under- 
stood that the disclosures are not limited to particular com- 
positions or biological systems, which can, of course, vary. 
This disclosure has been made with respect to the current state 65 
of the art, but also contemplates advancements and that adap- 
tations in the future may take into consideration of those 
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advancements, namely in accordance with the then current 
state of the art. It is intended that the scope of the invention be 
defined by the Claims as written and equivalents as appli- 
cable. It is also to be understood that the terminology used 
herein is for the purpose of describing particular embodi- 
ments only, and is not intended to be limiting. Reference to a 
claim element in the singular is not intended to mean “one and 
only one” unless explicitly so stated. As used in this specifi- 
cation and the appended claims, the singular forms “a,” “an,” 
and “the” include plural referents unless the content clearly 
dictates otherwise. The term “several” includes two or more 
referents unless the content clearly dictates otherwise. Unless 
defined otherwise, all technical and scientific terms used 
herein have the same meaning as commonly understood by 
one of ordinary skill in the art to which the disclosure pertains . 

Moreover, no element, component, nor method or process 
step in this disclosure is intended to be dedicated to the public 
regardless of whether the element, component, or step is 
explicitly recited in the Claims. No claim element herein is to 
be construed under the provisions of35 U.S.C. Sec. 1 12, sixth 
paragraph, unless the element is expressly recited using the 
phrase “means for ...” and no method or process step herein 
is to be construed under those provisions unless the step, or 
steps, are expressly recited using the phrase “comprising 
step(s) for . . . ” 

A number of embodiments of the disclosure have been 
described. Nevertheless, it will be understood that various 
modifications may be made without departing from the spirit 
and scope of the present disclosure. Accordingly, other 
embodiments are within the scope of the following claims. 
What is claimed is: 

1 . A digital communication coding method, comprising: 
selecting a desired rate to be implemented by a low-density 

parity-check (LDPC) code represented by a protograph; 
selecting a number of variable nodes and a number of 
check nodes to be implemented in the protograph; 
selecting constraints for the protograph; 
searching for all possible edges in the protograph to create 
computed permutations of the protograph; 
computing an iterative decoding threshold for each com- 
puted permutation of the protograph; and 
selecting the computed permutation of the protograph with 
a lowest computed iterative decoding threshold to 
implement the LDPC code. 

2. The method according to claim 1, wherein selecting 
constraints for the protograph comprises selecting contracts 
for the protograph to satisly a linear minimum distance prop- 
erty. 

3. The method according to claim 1, wherein at least one 
variable node comprises a punctured node. 

4. The method according to claim 1, wherein selecting a 
desired rate comprises selecting a rate of 1/2 and selecting a 
number of variable nodes comprises selecting 7 variable 
nodes and selecting a number of check nodes comprises 
selecting 4 check nodes and wherein the protograph is repre- 
sented by a proto-matrix having four rows and seven columns 
and selecting constraints comprises: 

constraining a first column of the proto-matrix to have a 
degree of 1 ; 

constraining a second column of the proto-matrix to have a 
degree of 2; 

constraining a third column of the proto-matrix to be punc- 
tured; and 

constructing a submatrix within the proto-matrix, wherein 
the submatrix comprises columns two through seven and 
rows two through four of the proto-matrix, wherein two 
or fewer columns in the submatrix have a degree of two 



US 8,689,083 B2 


19 20 

and all columns in the submatrix not having a degree of column dimension, and a third submatrix of the three 

two have a degree of three or greater and the maximum submatrices having a location defined by the added col- 

number of parallel edges represented in the third column umns and added rows, and wherein the first submatrix is 

of the submatrix is three and the maximum number of a zero submatrix; 


parallel edges represented in the remaining columns of 
the submatrix is two. 

5. The method according to claim 4, wherein the selected 
computed permutation of the protograph comprises the fol- 
lowing proto-matrix: 
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6. The method according to claim 1, wherein selecting a 
desired rate comprises selecting a higher rate based on a lower 
rate code implemented in a lower rate protograph having four 
check nodes and represented by a lower rate parity check 
matrix and selecting constraints for the protograph comprises 
constructing a higher rate parity check matrix for the selected 
higher rate, wherein the higher rate parity check matrix com- 
prises the lower rate parity check matrix extended with three 
additional columns, wherein a first row of the three additional 
columns comprises edges for a check node that connects to a 
degree- 1 variable node and rows two through four of the three 
additional columns comprise a subgraph, wherein sums of 
each column of the three additional columns within the sub- 
graph are three or higher. 

7. The method according to claim 6, wherein the edges in 
the subgraph are limited to two parallel edges or fewer. 

8. The method according to claim 1, wherein selecting a 
desired rate comprises selecting a higher rate code based on a 
lower rate code implemented in a lower rate protograph rep- 
resented by a lower rate parity check matrix and wherein 
selecting constraints comprises constructing a higher rate 
parity check matrix for the selected higher rate, wherein the 
higher rate parity check matrix comprises the lower rate par- 
ity check matrix extended with additional columns and 
wherein searching for all possible edges in the protograph 
comprises searching the higher rate parity check matrix and 
the LDPC code has a higher rate than the lower rate code. 

9. The method according to claim 8, wherein in a channel 
having one relay, the higher rate code is selected for trans- 
mission from a source to the one relay and a destination, and 
wherein the lower rate code is received at the destination, and 
wherein codeword symbols that appear in the lower rate code 
but not in the higher rate code are provided by the relay to the 
destination. 

10. A digital communication coding method for embedded 
rate-compatible LDPC codes, the method comprising: 

selecting a higher rate code represented by a higher rate 
parity check matrix with a higher rate row dimension 
and a higher rate column dimension; 

constructing a protograph represented by a lower rate par- 
ity matrix, wherein the lower rate parity matrix is created 
by extending the higher rate parity matrix by an equal 
number of added columns and added rows, wherein the 
added columns and added rows form three submatrices 
within the lower rate parity matrix, a first submatrix of 
the three submatrices having a location within the lower 
rate parity matrix defined by the added columns and the 
higher rate row dimension, a second submatrix of the 
three submatrices having a location within the lower rate 
submatrix defined by the added rows and a lower rate 


5 constraining edges in the second and third submatrix to 
maintain linear growth of minimum distance; 
searching for all possible edges in the proto graph to create 
computed permutations of the protograph; 
compnting an iterative decoding threshold for each com- 
pnted permutation of the protograph; and 
selecting the computed permutation of the protograph with 
a lowest computed iterative decoding threshold to 
implement an LDPC code. 

11. The method of claim 10, wherein the second submatrix 
comprises the following edges: 

edges in a first column of the second submatrix are set 
equal to zero; 

edges in a third column of the second submatrix comprise 
20 edges connecting to a highest degree variable node in the 
liigher rate parity matrix; and, 
edges in all other columns of the second submatrix com- 
prise edges connecting to all other variable nodes in the 
liigher rate parity matrix except a degree- 1 node, and 
25 wherein the third submatrix comprises a lower triangular 
matrix and the third submatrix comprises the following 
edges: 

edges at the main diagonal of the third submatrix are set 
equal to one; 

edges above the main diagonal of the third submatrix are 
set equal to zero; and 

edges below the main diagonal comprise edges that con- 
nect new variable nodes to new check nodes provided by 
the added rows and the added columns. 

12. The method of claim 10, wherein edges in a third 
colurmi of the second submatrix are set equal to 1 or 2, edges 
in all other columns of the second submatrix are set equal to 
0 or 1 and edges below the main diagonal of the third subma- 

40 trix are set equal to 0 or 1 . 

13. A digital communication coding method for rate-com- 
patible LDPC codes comprising: 

selecting a first rate code represented by a first rate parity 
check matrix; 

45 constructing a second rate parity check matrix by extend- 
ing the first rate parity check matrix by one or more rows 
or one or more columns or one or more rows and col- 
nmns; 

selecting constraints for a protograph resulting from the 
50 second rate parity check matrix; 

searching for all possible edges in the protograph to create 
computed permutations of the protograph; 
computing an iterative decoding threshold for each com- 
puted permutation of the protograph; and 
55 selecting the computed permutation of the protograph with 

a lowest computed iterative decoding threshold to 
implement an LDPC code, wherein the LDPC code 
comprises a code at a second rate. 

14. The method according to claim 13, wherein selecting 
60 constraints comprises for a protograph resulting from the 

second rate parity check matrix comprises selecting con- 
straints for the protograph to satisfy a linear minimum dis- 
tance property. 

15. The method according to claim 13, wherein the first 
65 code comprises a high rate code and wherein constructing a 

second rate parity check matrix comprises constructing the 
second rate parity check matrix by extending the first rate 
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parity check matrix by one or more added rows and wherein 
the LDPC code comprises a code at a lower rate than the high 
rate code. 

16. The method according to claim 15, wherein selecting 
constraints comprises for a protograph resulting from the 
second rate parity check matrix comprises selecting con- 
straints for the protograph to satisfy a linear minimum dis- 
tance property. 

17. The method according to claim 13, wherein the first rate 
code comprises a low rate code and wherein constructing a 
second rate parity check matrix comprises constructing the 
second rate parity matrix by extending the first rate parity 
matrix by one or more added columns and wherein the LDPC 
code comprises a code at a higher rate than the low rate code. 

18. The method according to claim 17, wherein selecting 
constraints comprises for a protograph resulting from the 
second rate parity check matrix comprises selecting con- 
straints for the protograph to satisfy a linear minimum dis- 
tance property. 

19. The method according to claim 15, wherein in a chan- 
nel having one relay, the high rate code comprises a high rate 
codeword and wherein the high rate code is selected for initial 
transmission from a source to the relay and a destination, and 
wherein the LDPC code comprises a low rate codeword 
received at the destination and wherein codeword symbols 
that appear in the low rate codeword but not in the high rate 
codeword are provided by the relay to the destination. 

20. The method according to claim 15, wherein in a chan- 
nel with multiple relays, the high rate code is selected for 
initial transmission from a source to the multiple relays and a 
destination, and wherein each relay produces and transmits 
codeword symbols corresponding to a difference between its 
received codeword and a next lower-rate codeword, and the 
destination receives and decodes a lowest-rate codeword. 

21. A method for transmission within a half-duplex relay 
channel having at least one relay, the method comprising: 

selecting a first LPDC code with a rate necessary to support 
transmission of source data from a source to a destina- 
tion, wherein the first LDPC code comprising a first 
LDPC codeword is represented by a first protograph; 

adding one or more second protograph variable nodes to 
the first protograph to create a second protograph, 
wherein the second protograph has a linear distance 
property and the second protograph implements a sec- 
ond LDPC code comprising a second LDPC codeword; 

transmitting data from the source with the source data 
encoded with the second LDPC code; 

receiving data coded with the second LDPC code at a relay; 

decoding the data received at the relay to extract the second 
LDPC codeword; 

selecting a subset of the one or more second protograph 
variable nodes of the second LDPC code and adding one 
or more relay variable and check nodes to the selected 
subset of the one or more second protograph variable 
nodes to create a third LDPC code comprising a third 
LDPC codeword; 

encoding a combination of selected one or more second 
protograph variable nodes and one or more relay vari- 
able and check nodes with a fourth LDPC code compris- 
ing a fourth LDPC codeword; 

transmitting from the relay the combination of selected one 
or more second protograph variable nodes and one or 
more relay variable and check nodes coded with the 
fourth LPDC code to the destination; 

decoding data received at the destination to extract the 
combination of selected one or more second protograph 
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variable nodes and one or more relay variable and check 
nodes coded with the fourth LDPC code; 
decoding a subset of the data received at the destination 
that constitutes the third LDPC codeword to extract a 
5 subset of the second LDPC codeword that excludes the 
first LDPC codeword; 

decoding a remaining part of data received at the destina- 
tion with the first LDPC code to extract the first LDPC 
codeword; and 

extracting the source data from the extracted subset of the 
second LDPC codeword at the destination. 

22. The method according to claim 21, wherein the first 
LDPC code comprises a rate- 1/2 code. 

23. A method for transmission within a half-duplex relay 
chamiel having at least one relay, the method comprising: 

selecting a first LPDC code with a rate necessary to support 
transmission of source data from a source to a relay, 
wherein the first LDPC code is represented by a first 
20 protograph; 

adding one or more check nodes and adding one or more 
variable nodes to the first protograph to create a second 
protograph, wherein the second protograph has a linear 
distance property and the second protograph imple- 
25 ments a second LDPC code, wherein the added one or 

more variable nodes correspond to the second LDPC 
code; 

transmitting first data from the source, wherein the first 
data comprises the source data encoded with the first 

30 LDPC code; 

receiving the first data coded with the first LDPC code at 
the relay; 

decoding the first data received at the relay to extract the 
source data coded with the first LDPC code; 

35 computing at the relay the added one or more variable 
nodes corresponding to the second LDPC code to pro- 
vide computed one or more variable nodes; 
encoding the computed one or more variable nodes with a 
third LDPC code; 

40 transmitting second data comprising the computed one or 
more variable nodes coded with the third LDPC code to 
a destination and transmitting encoded source data to the 
destination; 

decoding the second data received at the destination to 
45 extract the computed one or more variable nodes; and 
decoding the encoded source data received at the destina- 
tion using the computed one or more variable nodes to 
extract the source data from the encoded source data 
received at the destination. 

50 24. The method according to claim 23, wherein the first 

LDPC code comprises a rate- 1/2 code. 

25. A method for transmission within a half-duplex relay 
channel having two or more relays, the method comprising: 
selecting a first LPDC code with a rate necessary to support 
55 transmission of source data from a source to a first relay, 
wherein the first LDPC code is represented by a first 
protograph; 

adding one or more check and variable nodes to the first 
protograph to create a second protograph, wherein the 
60 second protograph has a linear distance property and the 
second protograph implements a second LDPC code; 
adding one or more check and variable nodes to the second 
protograph to create a third protograph, wherein the 
third protograph has a linear distance property and the 
65 third protograph implements a third LDPC code; 

transmitting first data from the source with the source data 
encoded with the first LDPC code; 
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receiving the first data coded with the first LDPC code at a 
first relay; 

decoding the first data received at the first relay to extract 
the source data coded with the first LDPC code; 
computing at the first relay, one or more added first relay 5 
variable nodes to produce a first LDPC codeword; 
encoding the one or more added first relay variable nodes 
with a fourth LDPC code; 

transmitting second data comprising the one or more added 
first relay variable nodes coded with the fourth LPDC 
code to a second relay and transmitting additional data 
contained the first LDPC codeword; 
decoding the second data received at the second relay to 
extract the one or more added first relay variable nodes 
coded with the fourth LDPC code; 
decoding the additional data received at the second relay 
using the extracted one or more added first relay variable 
nodes to extract the first LDPC codeword from the addi- 
tional data received at the second relay; 
computing at the second relay, one or more added second 
relay variable nodes to produce a second LDPC code- 
word; 
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encoding the one or more added second relay variable 
nodes with the third LDPC code; 
transmitting the third LDPC code from the second relay to 
a destination; 

decoding the third LDPC code at the destination to extract 
the one or more added second relay variable nodes; 
decoding the fourth LDPC code at the destination to extract 
the one or more added first relay variable nodes; and 
decoding a destination message using the one or more 
added first relay variable nodes and the one or more 
added second relay variable nodes to extract the source 
data. 

26 . The method according to claim 25 , wherein the first 
LDPC code comprises a rate-0.75 code. 

27 . The method according to claim 25 , wherein the half- 
duplex relay channel comprises at least three relays and each 
subsequent relay after the first relay and the second relay 
computes additional variable nodes to form additional LDPC 
codewords. 



